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METHOD AND SYSTEM FOR THE THREE-DIMENSIONAL SURFACE 
RECONSTRUCTION OF AN OBJECT 

FIELD OF THE INVENTION 

This invention relates to a system and method for the three-dimensional 
surface reconstruction of an object, in particular at least partially based on 
structured illumination techniques. The invention also relates to the labeling of 
elements between two images of an object or scene. 

BACKGROUND OF THE INVENTION 

The determination of a three-dimensional (3D) shape of an object is of 
important significance in many fields. For example, in the field of dimensional 
measurement of manufactured objects, accurate measurement of a number of 
predetermined dimensions and/or the surface coordinates of such objects can 
provide an important tool for determining the accuracy of the manufacturing 
process. 

Systems and methods for such 3D shape determination, particularly for 
industrial applications, have followed two main paths: mechanical and optical. 
Mechanical systems, while providing accurate 3D data for an objects, rely on 
mechanical contact between a probe and the object, and only one surface point at 
a time is measured, which results in a very slow, and often impractical, data 
acquisition rate. 

Optical systems may be based on any one of a number of different 
methodologies. In one category, a triangulation system is used for determining 
the 3D spatial location for points on the object on which projected beams of light 
are reflected. In another category, epipole techniques are used for the same 
purpose. In either case, scan-line systems project a single line of light on the 
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object, and the reflection of the projected line is read by a camera that is at some 
angle with respect to the projector apparatus axis of projection. This provides a 
contour on the image from which the position of the object section (where the 
line was projected) can be triangulated. In such systems, the line of light is 
progressively scanned over the object, and in this manner the full 3D shape of the 
. object is determined. However, this method also suffers from a long acquisition 
time, which can also introduce errors if there is any unknown movement between 
the camera and the object during this time. 

Improved scan-line systems can project a pliirality of scan lines 
simultaneously onto an object, and the reflections of all the lines are captured by 
a camera. While acquisition time is fast, it is difficult to provide matching 
between the lines in the image taken by the camera and the illumination grid, 
because there is an ambiguity as to which line in tiie illumination grid a particular 
reflected line corresponds to. This is particularly problematic when the object is 
itself complex and comprises sharp edges or steep surfaces, as is often the case 
for manufactured items. 

Various methods are known for solving the ambiguity problem. "Pattern 
Codification Strategies in Structured Light Systems", by J. Salvi et al (published 
April 2004) provides a general overview of such methods. In one time 
multiplexing strategy described therein, a temporal codification method, known 
as the Gray Code Method employs various spatial frequencies of binary patterns 
to illuminate an object. Typically, first two stripes are used, light and dark, to 
completely illuminate the area of interest on the object, and the reflection 
therefrom is recorded on an image. Then, the object is again illuminated, but with 
4 stripes, two light and two dark. The process is repeated several times, each time 
doubling the number of stripes, illuminating tiie same area of the object, and 
recording the reflections therefrom in a separate set of images. Any line on the 
object can be related to a particular original stripe from the xmique observed code 
at that location from the gray scale that was previously used to illuminate the 
object. 
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However, such a method requires multiple data acquisition steps, and also 
suffers from relatively large data acquisition time to obtain the 3D structure of an 
object. 

Spatial based methods are also known for solving the ambiguity problem, 
and some are also discussed in the aforesaid "Pattern Codification Strategies in 
Structured Light Systems" publication. Typically, a codeword that labels a 
certain point of a pattem is obtained from a neighborhood of points around it. 
Since the spatial neighborhood cannot always be recovered in the image, the 
decoding stage of the method can become problematic, and errors can arise. 
Further typically, the color or intensity of pixels, or groups of adjacent pixels are 
the visual features that may be gathered in the spatial neighborhood. In one 
spatial based method, a three-dimensional imaging system, marketed by the 
present Assignee under the name Optigo 200, illuminates a desired object, i.e., an 
object regarding which it is desired to determine its 3D structure, with a random 
grid of black and white pixels. Two or more cameras set at different angles with 
respect to the object each take a picture simultaneously of the object with the 
random grid superposed on it, and the grid pattem images captured by each 
camera are correlated one with the other. In such spatial based methods, a single 
spatial coding pattem is used for solving the ambiguity problem, and the methods 
then use the pixel correspondence between images thus found to find the 
coordinates of the surface of the object being investigated. 

Of general background interest, US 6,510,244 relates to a method for 
imaging a 3D object, wherein a pattem of lines in the form of a grid is 
illuminated onto an object, and the shape thereof is acquired on the basis of 
relative distances between the lines and/or intersections of the lines of the 
pattem. Also of background interest, US 6,252,623 relates to an imaging method 
and apparatus, in which the object is illuminated with a repetitive pattem of 
differently-colored bands to enhance the accuracy of the image obtained by 
reducing cross-talk between the colored bars of the captured image. 
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SUMMARY OF THE INVENTION 

Herein, the term "correspondence" refers to point to point mapping 
between different images of an object, typically at the pixel level, for example 
based on neighborhood-type coding. 

The term "labeling" is used herein to refer to the proper identification of 
patterns such as one-dimensional line patterns or quasi one dimensional stripe 
patterns between different images of an object. 

The term "matching" refers to sub-pixel to sub-pixel mapping between 
different images of an object. 

The term "image", in addition to the regular usage, is also used herein to 
include an original pattem that is projected onto an object. 

In the present invention, a methodology is provided for reconstructing 3D 
surface structure of an object. The term "object" includes any two or three 
dimensional object or a collection of objects including a scene. 

The method is based on enabling unique matching of each reflected point 
on an object with an illuminating pattem using a two stage approach, such 
matching being possible at the sub-pixel level. In the first stage, a first set of 
images is obtained, and a spatial coding technique is used for correspondence 
mapping of coordinates from a first image to a second image of an object. 
Neighborhood coding techniques are typically used for determining this 
correspondence. In one embodiment, a random grid or other structured light is 
used to illuminate the object, and the images are obtained at different angles with 
respect to the object. In other embodiments, surface features of the object may be 
sufficient to enable the aforesaid mapping to be effected from images obtained 
using imstructured light. 

In the second stage, a second structured illumination, typically comprising 
a striped grid, is used to obtain a second set of images, typically comprising two 
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further images of the object, and the mapping provided by the first stage provides 
proper labeling of the grid between these two images of the second set. 
Triangulation or epipole methods, or any other suitable method, can then be used 
for obtaining the 3D coordinates of the surface being reconstmcted. 

Thus, the present invention relates to a method for the three-dimensional 
surface reconstruction of an object comprising the steps of: 

(a) obtaining a first set of images of the object having a first structured 
pattern on the surface thereof, and determining correspondence of image points 
between images of said first set of images; 

(b) obtaining a second set of images of the object having a second 
structured pattem thereon, and labeling said second structured pattern between 
images of said second set of images based on the correspondence determined in 
(a); 

(c) matching elements between images of said second set of images based 
on the labeling determined in (b); and 

(d) determining spatial coordinates of the object fi^om matched elements of 
said images of said second set of images in (b). 

Typically, step (a) comprises the steps of: 

- obtaining said first set of images of said object, wherein said first 
stmctured pattem is defined by means of a uniquely coded stmctured pattem of 
structured light used for illuminating the object; and 

- finding correspondence between image points of images of said first set 
of images by mapping coordinates of one image on at least one other image 
based on coding related to the first stmctured pattem. 

The first set of images typically comprises two images at different angles 
with respect to said object. In a first embodiment of the invention, the two 
images are captured as images, substantially simultaneously, either by using two 
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cameras, or a single camera that is moved between two positions relative to the 
object. In a second embodiment, one image of said first set of images comprises 
said uniquely coded structured pattern and at least one other image of said first 
set of images is captured as an image, and thus only a single fixed camera is 
necessary. 

Typically, the uniquely coded structured pattern comprises a two 
dimensional random or pseudo random gray code, i.e., a two dimensional array 
having a random or pseudo random distribution of black and white elements. A 
pattern matching technique may be used for finding correspondence of image 
points in step (a). 

Typically, the second structured pattern comprises a periodic structured 
pattern illuminated on the object. The second set of images typically comprises 
two images at different angles with respect to said object. In a first embodiment 
of the invention, the two images are captured as images, either by using two 
cameras, typically simultaneously, or a single camera that is moved between two 
positions relative to the object. In a second embodiment, one image of said first 
set of images comprises said uniquely coded structured pattern and at least one 
other image of said first set of images is captured as an image, and thus only a 
single fixed camera is necessary. 

Thus, the second embodiment generally requires pre-knowledge of the 
pattern that is projected onto the object, and this requires projector calibration in 
addition to camera calibration. In the first embodiment, only calibration of the 
cameras is required. 

The relationship between the first set of images and the object is 
substantially similar to the relationship between the second set of images and the 
object, though small variations are generally acceptable. 

The periodic pattern typically comprises a first plurality of stripes of a 
first intensity or color intercalated with respect to a second plurality of stripes of 
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a second intensity or color. In one example, the first plurality of stripes comprise 
white pixels and said second plurality of stripes comprise black pixels. 

In particular, the following steps may be implemented in the second stage 
of the method:- 

a first element in a first image of said second set of images is associated 
according to a first association technique with a first image point of a first image 
of said first set of images; 

a second image point of a second image of said first set of images having 
correspondence with said first image point is determined; and 

said second image point is associated with at least one second element of a 
second image of said second set of images according to a second association 
technique, wherein said at least one second element matches said first element. 

According to said first association technique, said first element is an 
image element in substantially the same spatial location as the said first image 
point relative to their respective images. 

According to said second association technique, said at least one second 
element is an image element in a spatial location relative to its image that is at or 
in close proximity to the location of said second image point relative to its image. 

The first element typically comprises the centre point of a row of pixels of 
a stripe of the first plurality of stripes comprised in the first image of the second 
set of images. 

The second element typically comprises the centre point of a row of pixels 
of a stripe of the first plurality of stripes comprised in the second image of said 
second set of images. 

Step (d) may be based on triangulation techniques, or on epipolar 
reconstruction techniques, or on any other suitable techniques. 

The present invention also relates to a method for matching points between 
images of a first set of images of an object comprising the steps of: 
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(a) obtaining said first set of images of the object having a first structured 
pattern thereon; 

(b) obtaining a second set of images of the object having a second 
structured pattem on the surface thereof, and determining correspondence of 
image points between images of said second set of images; 

(c) labeling elements of said first structured pattem between images of said 
first set of images based on the correspondence determined in (b); 

(d) matching points comprised in elements between elements labeled in 
(c). 

The present invention also relates to a system for the three-dimensional 
surface reconstruction of an object comprising:- 

(I) a projector adapted for selectively illuminating said object with a first 
structured pattem and a second structured pattem; 

(II) at least one camera for obtaining images of said object when 
illuminated with said first stmctured pattem and a second stmctured pattem; 

(III) microprocessor means for determining three-dimensional surface 
topology of said object based on said images 

The microprocessor means, typically a computer, is adapted for 
determining said topology according to the method the invention. 

The method of the invention can be incorporated in a computer readable 
medium for instructing a suitable computer to carry out the method. 

The present invention also relates to a control unit for use in the three- 
dimensional surface reconstmction of an object, said control unit being 
preprogrammed to carry out 
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(i) processing data indicative of a first set of images of the object having a 
first structured pattern on the surface thereof, and determining correspondence of 
image points between images of said first set of images; 

(ii) using said correspondence for processing a second set of images of the 
object having a second structured pattern thereon to map elements of said second 
structured pattern between images of said second set of images; 

(iii) analyzing the matched elements to determine spatial coordinates of 
the object. 

Thus, the present invention applies a correspondence method to provide 
correct line-to-line labeling, providing fast and correct labeling, and with only 
using two sets of images of the object, and this may provide fast and accurate 3D 
reconstruction of a surface. In particular, the first stage of the method provides an 
effective means of correspondence, in only a single data acquisition step, and this 
correspondence may then be used to perform the line-to-line labeling, allowing 
the 3D reconstruction to be performed with sub-pixel level of accuracy. 



BRIEF DESCRIPTION OF THE DRAWINGS 

In order to understand the invention and to see how it may be carried out 
in practice, a preferred embodiment will now be described, by way of non- 
limiting example only, with reference to the accompanying drawings, in which: 

Fig. 1 is a schematic illustration of the method according to an 
embodiment of the invention. 

Fig. 2 is a schematic illustration of the elements of a first embodiment of 
the system of the invention. 

Fig. 3 illustrates a random or quasi-random pixel pattern used with the 
embodiment of Fig. 2 or of Fig. 10. 
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Fig. 4 illustrates images obtained with the system of Fig. 2 when the 
object is illuminated with the pattern of Fig. 3. 

Fig. 5 illustrates a line pattern used with the embodiment of Fig. 2 or of 
Fig. 10. 

Fig. 6 illustrates images obtained with the system of Fig. 2 when the 
object is illuminated with the pattem of Fig. 5. 

Fig. 7 illustrates a method for obtaining the coordinates of a point on an 
object using images obtained with the system of Fig. 2 when the object is 
illuminated with the pattem of Fig. 5. 

Fig. 8 illustrates a triangulation method for obtaining the coordinates of a 
point on an object using images obtained with the system of Fig. 2 when the 
object is illuminated with the pattem of Fig. 5. 

Fig. 9 illustrates an epipole based method for obtaining the coordinates of 
a point on an object using images obtained with the system of Fig. 2 when the 
object is illuminated with the pattem of Fig. 5. 

Fig. 10 is a schematic illustration of the elements of a second embodiment 
of the system of the invention. 

Fig. 11a and Fig. lib illustrate a random or quasi-random pixel pattem 
projected, and the image received, respectively, by the projector and camera of 
the embodiment of Fig. 10. 

Fig. 12a and Fig. 12b illustrate the line pattem projected, and the image 
received, respectively, by the projector and camera of the embodiment of Fig. 10. 



DETAILED DESCRIPTION OF THE INVENTION 

An embodiment of the method of the invention, generally designated with 
the reference numeral 100, is illustrated in Fig. L In a first stage. Stage I, of the 
method, and also referring to Figs. 2, 3 and 4, an object O is illuminated with a 
structured illumination, such that a unique coding (light pattem) may be 
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concentrated in a single illumination. As illustrated schematically in Fig. 3, such 
a structured illumination typically comprises spatial coding in the form of a 
random or quasi random pixel pattem. A, such that preferably each matrix of 
[nxm] pixels in the pattern is unique. In this embodiment, the pixel pattem A is 
essentially a two-dimensional gray scale, wherein the pixels are colored black or 
white. The distribution of black and white pixels may be random. Altematively, 
the distribution may be "quasi-random", i.e., specifically designed so that for any 
matrix of [n by m] pixels within the grid (pattem), there is a unique permutation 
of white and black pixels not found anywhere else in the grid A. In practice, it is 
usually sufficient to provide local uniqueness, rather than global uniqueness, for 
grid A, so that parts of the pattem in the grid may actually be repeated within the 
grid, but at some distance from one another. 

In step 110, images of the object O are provided by simultaneously 
capturing two images of the object O, that is Ii and I2 respectively, with the 
pattem A superposed on the object, as illustrated schematically in Fig 4. 

In step 120, these images can then be processed to identify each part of the 
image I2 as corresponding to a part of image Ii, according to the unique 
distribution of white and black pixels, as described further herein. Any suitable 
decoding, pattem recognition or pattem matching methods may be used for this 
purpose. When viewed superposed on the object, the pattem A will appear 
distorted, according to the topography of the object O, and moreover the type and 
extent of this "distortion" will usually vary according to the viewing angle with 
respect to the object O. Each image Ii, I2, will comprise a pattem, Ai, A2 
respectively, which appear distorted relative to the original pattem A, and 
generally different one from the other, since as is known the projection of a 3D 
entity such as a curve, for example, in two 2D planes results in two different 
curves in these planes. 

The first image Ii may be regarded as a coded image of the object O, and 
consists of a plurality of black and white pixels in a global rectangular matrix, 
and this matrix is divided into all possible local [nxm] matrices, which may thus 
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sometimes overlap one with another to some extent, so that each pixel of the first 
image Ii can be assigned an [nxm] matrix centered on it. Of course, pixels at the 
edges and comers of the image may only have a part of such a matrix associated 
therewith, and the following method can also be applied to such matrices, mutatis 
mutandis. For example, such [nxm] matrices are [5x5] matrices, though the size 
and aspect ratio of the matrices may vary depending on the size and other 
characteristics of the image II. 

An exemplary "decoding" procedure regarding the second image is 
executed as follows, and is based on neighborhood coding techniques. Taking for 
example matrix Mi in image Ii, such as a [5x5] matrix centered on a particular 
pixel having coordinates (xi, y{) in image Ii, a search is conducted in the other 
image, I2, to find the location of a similar [5x5] matrix in which the black/white 
pixel pattern thereof correlates the best with the pixel pattern of matrix When 
this matrix, M2, is found, the coordinates of the center thereof, (X2, yi) are noted. 
These center coordinates may refer to a pixel, or alternatively, suitable methods 
may be employed to provide a sub-pixel level of accuracy for these coordinates. 
This operation is repeated for every pixel (and thus for every possible [nxm] 
matrix of pixels) in image Ii, thereby effectively mapping the coordinates of the 
centers of pixels in image Ii to those of image I2. In this manner, every part of 
the image Ii can be effectively mapped with respect to image I2. 

Where the grid A only comprises local uniqueness, and thus there is some 
repetition of the pattern within the grid, it is possible to nevertheless find the 
correspondence between the two images and thus map each matrix fi*om image Ii 
to image I2. This may be done, for example, by associating each matrix in Ii, say 
for example Mi, with a number of other matrices Min that are situated in close 
proximity to, i.e., in the neighborhood of. Mi. If there are a number of matrices 
M2' in the second image K which correlate with Mi, then the particular one of 
matrices M2' that has in its vicinity the matrices M2n that are correlated with the 
aforesaid matrices Mi„ is chosen as being the matrix corresponding to Mi. 
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Alternatively, rather than using a random grid based on a gray scale, it is 
possible to use a random grid based on a color scale instead, for example as 
described in the aforementioned "Pattern Codification Strategies in Structured 
Light Systems" reference, the contents of which are incorporated herein in their 
entirety. 

In step 130 of stage II of the method, and referring to Fig. 5, a second 
structured pattem, is projected onto the object O, and a further two images, 
comprising images Ki, K2 are taken, as illustrated in Fig. 6. The second 
structured pattem is now a periodic pattem, typically a striped illumination 
pattem B formed of an array of spaced apart stripes, i.e., comprising substantially 
parallel stripes of white pixels separated by stripes of black pixels. Alternatively, 
the pattem B may be comprised of any desired combination of colors. 

In step 140, each part of each of the stripes or lines Li, L2....Ln in one 
image or image K] can be identified and labeled as corresponding to a particular 
line number Li', L2*..-.Ln' in the other image or image K2, for example, as 
follows. 

Referring to Fig. 7, and taking a line L3 in image Ki, for example, the 
centre points Qn thereof are found for each pixel or set of pixels along the length 
of line L3, and there are several known methods for finding the center points 
accurately, for example the zero crossing method. For one such center point, qo, 
corresponding to pixel N©, the coordinates thereof are determined, say (xi', yi'). 
Then, these coordinates are mapped to image K2 according to the correspondence 
previously obtained with the structured illumination in Stage I, i.e., to location qr 
(X2\ y2*)- Then, in the labeling stage, image K2 is searched in the vicinity of (X2*, 
y2) to find the line segment Lj* of any one of lines Li% La\.,Jun that is closest to 
(X2', y2% in Fig. 7 identified as La*. 

Next, elenients between images Ki and K2 are matched. First, the pixels 
or set of pixels Qi, Q3 along L3' having centers qi and qa closest to (X2*, y2') are 
identified. The coordinates in K2 corresponding the closest to coordinates of q©. 
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(xi*, yi'), of Ki, according to stage II, are considered to be somewhere between 
these centers qi, qy 

In step 150, the coordinates (Xi, Yi) of the object O corresponding to (xi', 
yi') are then obtained as follows. A space ray Pi is defined by point qo (xi', yi') 
and the center of projection CPi of image Ki, Then, a plane S is defined by 
points qi, and the center of projection CP2 of image K2. The intersection point 
D of ray Pi with plane S provides the coordinates (Xi, Yi) object O, or a close 
estimation thereof. 

Altematively, and as illustrated in Fig. 8, coordinates QCi, Yi) of the 
object O corresponding to (xi', yi') are obtained as follows. A space ray Pi is 
defined by point (X]', yi') and the center of projection CPi of image Ki. Next, 
image K2 is interpolated to provide the coordinates of the centre point qs of line 
L3' having the same yi' coordinate as the mapped point q^ (X2', y2')' The point qs 
is considered to be matched to point q©. Then, a space ray P2 is defined by point 
q5 and the center of projection CP2 of image K2. Triangulation methods can then 
be used to find the intersection D' of rays Pi, P2, or at least the point of minimum 
distance between Pi and P2, and this provides the coordinates of point (Xi, Yi), 
or a close estimation thereof. 

Altematively, and as illustrated in Fig. 9, an epipole reconstruction-based 
method may be used for obtaining the coordinates of point D" (Xi, Yi) of the 
object O corresponding to qo (xi', yi'). First, the coordinates of qo (xi', yi') are 
mapped to point q^ (X2', y2*) on image K2 according to the correspondence 
previously obtained with the structured illumination in Stage I. Then, as before, 
image K2 is searched in the vicinity of (X2', y2') to find the line segment of any 
one of lines Li% L2\...L„' that is closest to (X2, y2'X i-^-^ La'- A space ray Pi' is 
defined by point qo and the center of projection CPi of image Ki, and thus passes 
through point D". An epipolar line EPL connects CPi with the center of 
projection CP2 of image K2, and images Ki and K2 at epipoles EPi and EP2, 
respectively. The projection of point D" onto image K2 is constrained to lie on 
the epipolar line PP, which passes through EP2, and the relationship between D" 
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and PP is described by the corresponding Fundamental matrix, as is known in the 
art. Then, the locus of centre points LCP of La', found using any suitable 
method, such as for example the zero crossing method, is intersected by epipolar 
line EE to provide the coordinates of the centre point qs corresponding to qo. 
The point qs is considered to be matched to point qo- Epipolar methods can then 
be used to determine the coordinates of point D, (Xi, Yi). 

Optionally, the first stage of the method can be implemented without the 
need of a grid A if the object O comprises a suitable structured surface pattem, 
using unstructured light. In such a case, it is only necessary to obtain two images 
of the object and to map the coordinates of one image to the other image via 
suitable pattem matching techniques on the basis of local uniqueness of this 
surface pattem. 

Referring to Fig. 2, the method of the invention according to this 
embodiment may be carried out using a system 200. System 200 provides the 
required illumination for Stage I and Stage II using projector P, and at least two 
images are obtamed with two cameras, Ci and C2, at different angles with respect 
to the object O. Typically these images are taken substantially simultaneously. 
Alternatively, a single camera that is moved between at least two positions at 
different angles may be used to provide the two images. A microprocessor means 
(not shown) such as a suitable computer processes the images obtained by the 
cameras Ci arid C2, typically via an image grabber, according to the method of 
the invention. 

There are many ways for illxuninating the object. For example, a light 
emitter may be used having a mask, the mask selectively enablmg either pattem 
A or pattem B to be illuminated onto the object. The mask can be a so-called 
"passive" mask, for example two masks defining fixed patterns A and B, 
respectively, selectively locatable in the optical path of light generated by the 
light emitter. Such a passive mask ihay be in the form of a rotating disc, one half 
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of which comprises pattern A, and the other half pattern B, and the disc is rotated 
by 180'' to bring the required half in alignment with the light emitter. 

Altematiyely, the mask may be a so-called "active" mask, in the form of a 
spatial light modulator (SLM) operatively connected to a control module, and 
under the control of the latter, the SLM provides the required pattern A or pattern 
B. 

Alternatively, the light emitter itself may be configured to generate 
structured light. This may be implemented by using a matrix of light-emitting 
elements. Such a matrix may be designed in accordance with a fixed pattem A or 
B, or may be configured as a suitable light emitting modulator, operatively 
connected to a control module, to selectively illuminate the object with pattem A 
or pattem B. 

Altematively, a laser speckle arrangement may be used to provide the 
random pattem. 

In other embodiments, more than two cameras may be used, each of which 
captures an image of the object illuminated with the random pattem A, and each 
of the images is correlated with the other images in a similar manner to that 
described above, mutatis mutandis. 

The spatial relationship between the cameras Ci, C2, the projector P, and 
the object O is preferably substantially unchanged fi"om the time the first and 
second set of images were acquired, and thus, typically, the sets of images Ii, I2, 
and Ki, K2 are taken in very quick succession. Nevertheless, it is possible for 
some relative movement to occur without affecting accuracy, typically where 
such movement is less than half the distance between the lines of the striped 
illumination pattem B. 

A second embodiment of the invention is illustrated in Fig. 10, and 
comprises all the elements of tiie first embodiment, with the following 
differences, mutatis mutandis. 
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In the second embodiment, the first set of images comprises the uniquely 
coded structured pattern itself that is used to illuminate the object. Thus, the 
object O is illuminated with a structured illumination, in Stage I, comprising a 
random or quasi random pixel pattern, such as pattem A (Fig. 11a), such that 
preferably each matrix of [nxm] pixels in the pattem is imique. However, only 
one image is captured by a camera or the like, providing an image I3 of the object 
O, with the pattem superposed on the object, as illustrated in Fig. l ib, the other 
"image" of this set being the pattem A itself (Fig. 11a). As with the first 
embodiment, the pattem A will appear distorted when viewed superposed on the 
object, relative to the original pattem A. In this embodiment, rather than finding 
the correspondence between two images taken by different cameras, the image I3 
is correlated with the original pattem A. In a similar manner to the first 
embodiment, though, the pattem A is divided into all possible [nxm] matrices, 
which may thus sometimes overlap one with another to some extent, and it is 
attempted to map each pixel in pattem A to a corresponding location in I3. 
Typically such [nxm] matrices are [5x5] matrices, though the size and aspect 
ratio of the matrix may vary depending on the size and other characteristics of 
the image I3. 

Thus, in a similar manner to that described for the first embodiment, 
mutatis mutandis^ Image I3 is effectively decoded to provide correspondence 
between the coordinates of, say, nodal points in the grid A and the image I3. 

In Stage II, a periodic stmctured illumination such as a striped 
illumination pattem B (Fig. 12a), for example, is projected onto the object O, and 
image K3 is taken, as illustrated in Fig 12b. Here, the second set of images 
comprises the pattem B, and an image taken of B superimposed over the object 
O. Each part of each of the stripes or lines in the original pattem B can be 
identified as corresponding to a particular line number in the other image K3, and 
each center point of each said part can be matched to a corresponding part in a 
line in K3 that has been labeled with respect the part of the line in original pattem 
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B, to provide the coordinates of the object, in a similar manner to that described 
for the first embodiment regarding images Ki and K2, mutatis mutandis. 

According to this embodiment, the method of the invention may be 
carried out using a system 200', which provides the required illumination for 
stage I and stage II, using projector P, and comprises a camera C, aligned at 
different angle with respect to the object O from that of projector P, A 
microprocessor means (not shown) such as a suitable computer processes the 
images obtained by the camera C, typically via an image grabber, together with 
the pattems A and B, according to the method of the invention. 

The spatial relationship between the camera C, the projector P, and the 
object O is preferably substantially unchanged from the time the images I3 and 
K3 were acquired, and thus, typically, images I3 and K3 are taken in very quick 
succession. Nevertheless, it is possible for some relative movement to occur 
without affecting accuracy, typically where such movement is less than half the 
distance between the lines of the striped illumination pattern B. 

In the method claims that follow, alphabetic characters and Roman numerals 
used to designate claim steps are provided for convenience only and do not imply 
any particular order of performing the steps. 

Finally, it should be noted that the word "comprising" as used throughout 
the appended claims is to be interpreted to mean "including but not limited to'*. 

While there has been shown and disclosed exemplary embodiments in 
accordance with the invention, it will be appreciated that many changes may be 
made therein without departing from the spirit of the invention. 



